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ABSTRACT 



Imagine a signal acquisition system composed of a 
number of receivers or sensors concurrently scanning the 
same domain for signals. It is reasonable to expect that 
different signals will each be detected by a different 
subset of receivers over the scanning period. Using the 
data collected from the receivers, it is possible to es- 
timate the total signal population size including those 
signals not detected by any receiver. Additionally, it 
is possible to estimate the probability each individual 
receiver detects signals. Several estimators are devel- 
oped for these quantities in the context of a model 
designed to represent the signal detection process. This 
model forms the basis for a simulation conducted to analyze 
the behavior of the estimators over a variety of conditions. 
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I. 



INTRODUCTION 



Imagine transmission devices emitting signals in the 
electromagnetic spectrum at unknown times and of unknown 
quantity. Further, imagine there are receivers concur- 
rently scanning the spectrum in an effort to detect the 
transmissions. Suppose there are k receivers in the sys- 
tem and a record is kept of each signal detected by each 
receiver. It is reasonable to expect that some signals 
will be detected by only one receiver, some by more than 
one receiver, and some signals will not be detected at 
all. Assume each signal is identifiable by its charac- 
teristics making it possible to determine whether detec- 
tions by several receivers were actually detections of a 
common signal. The purpose of this thesis is to demon- 
strate how data collected by the acquisition system can 
be used to estimate the total number of signals exposed 
to the system including the number of signals not de- 
tected by any receiver. It would, additionally, be 
interesting to know the probability each receiver in the 
system detects signals, and this problem will also be 
discussed. 

It would stand to reason that the detection process 
is some function of the receiver's capability to detect a 
signal as well as the signal's ability to be detected. 
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One such functional relationship (see Barr [Ref. 1] ) will 
be proposed in the context of a model developed to repre- 
sent the signal detection process. Various estimation 
principles such as maximum likelihood, method of moments, 
and least squares will be used to develop estimators for 
the total signal population size and the receiver intercept 
probabilities . 

A development of several estimators will be shown in 
detail and their applicability to this problem discussed. 
These estimation procedures will then be incorporated into 
a general model constructed to represent the detection 
process. This model supports the conduct of a computer 
simulation which also includes the generation of signals 
with varying signal strength and simulates detections of 
the signals by the receiver system. The resulting esti- 
mates are compared to the actual number of signals gener- 
ated and the expected receiver intercept probabilities to 
provide some insight on the quality of the estimators. 

The estimators are exposed to various conditions of the 
signal process and their behavior analyzed. 



9 



II. 



GENERAL MODEL 



In a statistical approach to modelling the physical 
phenomenon of signal detection, it is desirable to develop 
a model of sufficient generality such that the factors 
associated with radio and radiowave theory can be broadly 
parameterized. This generality has a distinct advantage in 
that it is not necessary to precisely define what type of 
sensor is being used nor what necessarily constitutes a 
signal. A detection is presumed to be some interception 
of a signal by a sensor which enables the signal to be 
identified. It may be that a signal, once detected, is 
lost and then redetected. This model similarly presumes 
that a reoccurence of a signal may also be identified. It 
is also desirable to prescribe a uniform method for counting 
or indexing detections in a manner which is conveniently 
applied to mathematical formulae and computer code. 

A. SIGNAL DETECTION 

It is possible to postulate functional values for the 
probabilities of signal detection letting rf— he defined to 
be the probability that receiver i detects signal j, inde- 
pendent of other signals. Each receiver or sensor, regard- 
less of similarities to one another, will be peculiar in 
its relative ability to detect a given signal. Each signal 
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j has certain characteristics such as intensity or fre- 
quency which affect its ability to be detected. (Depending 
on the circumstances, a signal may have a variety of 
identifiable characteristics. For the purpose of this re- 
port, these characteristics are considered to be aggregated 
and called the "strength" of the signal.) Let the random 
variable V be defined as some measure of these character- 
istics where 0<V<1. Let (V) represent a specific 
function that receiver i is "able" to detect a random sig- 
nal. Thus, a general expression, tT— = T^ (v ^ ) , relates 
the ability of receiver i to detect a signal, to the ability 
of signal j to be detected. For any future random signal 
V, Tti = T. (V) . 

The form of the function considered in this model is 
Tf^ = T^ (V) = 1^ • V, where 1^ denotes the proportion of 
signals of strength V that receiver i would detect. It is 
easily seen that if all signals were certainly detectable, 

V would take on the value one and T^(v) = 1^. Similarly, 
if all receivers were of equal specification and certainly 
able to detect a given signal for any v, 1^ = 1 and 
T^ (v) = v for all i. Various conditions on 1^ and distrib- 
utions for V will be considered. 

B. METHOD OF INDEXING 

Consider that over some specified time, s (unknown) 
signals will be scanned by k receivers in a signal intercept 



system. For any given signal, define the random variable Z 
to be a k-component vector whose components consist of 

z. = 0 if receiver i did not detect the signal and 2 . = 1 

1 1 

if receiver i did detect the signal. Thus, Z^ is a Bernoulli 
random variable. Let S denote the sample space of Z, so S 
contains 2 k-dimensional vectors of 2 eros and ones. This 
naturally includes the zero vector which contains the un- 
observable outcome that no receiver detected the signal. 

Over some specified amount of time, for each 2 tS, let 

n denote the number of times that outcome Z = 2 occurs and 

2 

let n be a 2 -dimensional vector whose components are the 
n 2 's. For example, in a k = 2 receiver system, S = ((0,0), 
(1,0), (0,1), (1,1)} . The first element, the 2 ero vector 
is an unobserved signal. The second element represents a 
signal detected by receiver 1 only, the third by receiver 2 
only, and the last represents a signal detected by both 
receivers. Any given detected signal will appear as an 
outcome on ZeS. Over many signals, n z _(i qj is the number 
of times that receiver 1 only detected the signals. The 
sum over all n 2 will be the total number of signals detected 
by the acquisition system. Because n z _(Q q) is the number 
of signals not detected, n 2 «s, where s was the total 

unknown number of signals present. Let N be the random 
vector with outcome n. It follows that N is distributed 
according to the multinomial law, N~M , (s,p), where p 
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v 

is the 2 -dimensional vector denoting the probabilities 
that a type z outcome occurs. 
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III. ESTIMATION PROCEDURES 



Several procedures are considered for estimating the 
total number of signals which pass through an acquisition 
system. Estimators for receiver intercept probabilities 
are developed for each approach. The maximum likelihood 
approach uses the properties of the multinomial distribu- 
tion in conjunction with numerical methods for maximizing 
the likelihood function. A method of moments procedure is 
developed which finds a solution vector to a set of simul- 
taneous equations based on the binomial characteristics of 
each receiver. Finally, a least squares approach, again 
with numerical methods, minimizes the square error between 
actual and expected detection outcomes for find estimates 
of signal population size and receiver intercept 
probabilities . 

A. MAXIMUM LIKELIHOOD/CONDITIONAL MAXIMUM LIKELIHOOD 

The concept behind this procedure is one of estimating 
the size of a multinomial population with incomplete obser- 
vations. This technique follows an approach discussed by 
Sanathanan CRef. 2] . It is convenient, in the statistical 
sense, to imagine a set of cells representing the 2 
elements in the sample space S described in section II. A 
detection by some subset of sensors in the k-receiver system 
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adds a count of one to the appropriate cell. Recall that 
after many signals, the total counts in each cell will com- 
prise the 2 -dimensional vector N. N is distributed 
multinomial , 

M , (s ,p) . 

2 K 

Suppose the ordering within the vector N is such that the 

number of signals which missed detection is placed cell n Q 

and has probability p Q . Let r denote the number of remain- 

k <r- r 

ing cells, r = 2 -1. Define t = 2_^_ ^ n^, thus n Q = s-t. 
The observation of (n^,...,n ) yields the likelihood func- 
tion L, 

n 1 n r s-t 

L(s,p) = si (p.) . . . (p ) r (p_) S 

n 1 I . . .n ! (s-t ) l r ° 

L(s,p) may also be written as the product 



L (s ,p) = L 1 (s ,p) L 2 Cp) 



where 



L 1 (s , p) = sJ (1-pJ (pj 
1 t! (s-t)! ° ° 



s-t 



(1) L 2 (p) 



n 1 n 

t ! (q ) ... Cq_) r 

■ r» * r 



n 1 : . . .n : 



with 



q i = p i //(1 " p o ) ' 1 = 1 ' * • * ' r * 

is the likelihood based on the probability of t and hence 
l >2 is the likelihood based on the conditional probability 
of (n^,...,n r ) given t. The following lemma is known (see 
e.g. Chapman (1951)). 
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LEMMA: For any given p, § = (t/(1-p Q )) (greatest integer 

(t/1-£> o )) maximizes L^(s / p Q ) / where L^(s,p o ) is 
defined above. If 1-£ = t/s ' for some integer 
s', then § and s-1 both maximize L^(s/P ). Other- 
wise, § is the unique maximum. 

Since p^ = 1, the sum over p^, i = 1,...,r will 

uniquely specify p . Hence, to find an estimate of s, it 

is only necessary to maximize the conditional likelihood 

function L 2 (p). More conveniently, the maximum of the 

log-likelihood function is found. Equation (1) may be 

transformed as follows: 

(2) log(L 2 (p)) = log (K) + n 1 log(q 1 ) +...+ n r log(q r ), 
where K = t!/ (n^ ! . . .n ! ) . 

Equation (2) can be rewritten as 

log(L 2 (p)) = log(K) + m^log( TL) + 

^-i=1 (t ~ m i )log(1 " TI i ) " 
(s-t)logd-(l- A, T1 i ) ) , 

where m. denotes the sum of cell counts in S for which 

l 

receiver i had detections Ci.e. receiver i only detected, 
receiver i and receiver j both detected, etc.) and t-nt 
represents the number of non-detects by receiver i. Thus, 
it is possible to solve directly for estimates of the 
receiver intercept probabilities, rf , without solving for 
the 2 components of p. 

Since K does not depend on p, it is not necessary to 
include log(K) when maximizing (.2). Given that each value 
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of ru , i^O is observable, it is possible using a numerical 
method such as the generalized reduced gradient to maximize 
the function for optimal values of rf^ • The value for p Q 



is clearly B = .i\ ( 1 - ft ) and from the lemma, "s = t/(1-i? ) 
- 1 r o i=1 1 r o 



B. METHOD OF MOMENTS 

As previously defined, nu denotes the total number of 

detections made by receiver i. Since each detection can be 

considered a Bernoulli trial, the random variable M. is 

i 

distributed Binomial (s , tf^) . For a k-receiver system 



m^ = § 



*1 



m 2 = s ft 2 



“k 



= £ 



ft, 



The parameters s and rt are all unknown, hence k + 1 un- 
knowns exist in the above k equations. To obtain a k + 1 
equation, consider all the signals which were detected by 
two or more receivers in the system. Define 



st 



m* = • • (.number of signals detected 

1<J simultaneously by re- 
ceivers i and j ) . 



If independence between receivers is assumed 

E(m') = s Z £<j TT 



= s 



r i<j <“yys 2 > 



= 11. m.m. 

s i<D 1 j 



The estimators for s and rf^ thus become § = (21^. m.m.l/m 1 



and f} i = m i m*/Z i< j m.m_. . 
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C. LEAST SQUARES 

Define A to be the event that one or more receivers 

detect a given signal. Hence, P(A) is the probability that 

the acquisition system will successfully intercept any given 

signal. Now, nn is defined to be the number of events for 

which receiver i had detections, and t, the total number of 

detections by the system. Following a procedure developed 

by Knorr [Ref. 3] , it is possible to postulate an estimator 

for Tf. as follows: 

1 

(3) fr. = (m./t) • P(A) . 

In this expression, iru/t denotes the proportion of signals 
detected which were observed by receiver i. 

Define to be the number of receivers which detect a 
signal , 

z = I k , z. Oszsk. 

A value for z % can be assigned for each signal intercepted. 
Further, let I- 1 represent the number of occasions where 
z. = j, and let P be the mass function for z. . It fol- 
lows that P (j) will be the probability that exactly j re- 
ceivers will detect a given signal. A possible estimator 
for P is 

(4) $ (j) = (,I j /t) • "P (A) . 

Note that for j = 0, 

$ z (0) = 1 - f (A) . 
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Both estimators for tt and P z (j) rely on estimating 

the value of P (A) , where 0 < P (A ) < 1 . By setting a value to 

P(A) , say P (A) , and given values for rtK , 1-^ , and t, one can 

find p (j) as a function of P (A) , using (4). Using the 
z 

same value for P(A), one can similarly compute "fr using (3). 

It is possible to find a similar value for P (j), denoted 

as P (j), by making use of its functional relationship to 
z 

rT. . Knorr suggests the following algorithm to compute 

1. Calculate q. = ft. /(I - ft. ) 

^1 1 1 

J< 

2. Expand TJ^ (x + q^) to obtain the polynomial 

k v_ 1 

a x + a . x + ... + a, 

o 1 k 

3. Calculate P z (j) = a n /^j =0 a ] < * 

Now form the square error of P (A) , where 

(5) E 2 (P(A)) = Hj =0 (^ 2 (j) - ? 2 (j)) 2 - 

By varying £(A) over its range, it is possible to find a 
"least squares" estimate, 0s?(A)s.1, which minimizes the 
above expression. Using ^(A), TT^ can be found using (3). 

The total signal population size passing through the 
acquisition system is estimated by 's = t/P (A) . 
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IV. THE SIMULATION 



Three methods have been discussed which provide esti- 
mators for determining receiver intercept probabilities. 
Similarly, estimators are found for the total number of 
signals passing through an acquisition system given only a 
portion of the signals were detected. In this section, the 
techniques used to test each method will be discussed. 

The three methods of analysis were used as the basis for 
a model developed to support a computer simulation. The 
model was designed to perform two major functions necessary 
for the simulation. The first function is to generate sig- 
nals simulating the transmission of signals from some source. 
The second function of the model is to statistically relate 
each signal to each receiver to determine actual detections. 
During the simulation, each receiver must either detect or 
not detect a given signal. Thus, an accounting procedure 
was developed relating each receiver to each signal. Fi- 
nally, the model applies each method of analysis to the data 
generated and estimated values of intercept probabilities, 

Tt\, and total signals, 's, are compared to the E ( / TT^) , and 
the number of signals specified to the signal generator. 

The simulation is performed in two parts. The first 
consists of one replication of each method in each of 72 
different situations. A situation or environment is 
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comprised by varying 

1. ..The total number of signals generated. 

2. The number of receivers in the acquisition system. 

3. The parameters specifying the relative "ability" 
of a receiver to detect a signal. 

4. A parameter specifying the relative "ability" of a 
signal to be detected. 

The second part of the simulation replicates twelve of the 
above environments 100 times each, thus enabling an analysis 
of mean absolute error, bias, and variance of the estimators. 

A. INPUT: "MAIN ROUTINE" 

The main routine reads all required data and subsequently 
calls each subroutine in sequence. Input requirements for 
the simulation include the random number generator seed, the 
number of signals to be generated, the number of receivers 
in the system, each receiver's ability to detect a signal 
of strength V, the parameter specifying the "ability" of a 
signal to be detected, and the method of analysis to be 
used . 

Various loops in the main routine can be established to 
test one or more methods on many data sets (environments) 
or to replicate over one data set. 

B. SIGNAL GENERATION: "SUBROUTINE GNRATE " 

Recall that T^ (V) represents the specific function that 
receiver i is able to detect a random signal and that the 
form of the function used (see II. A.) in this model is 
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( 6 ) 



V . 



T. (V) =1. • 

l l 

In the simulation, 1^ is a user input denoting elements of 
the probability vector specifying the ability of receiver i 
to detect any given signal. Now, suppose V is a Beta(«<,1) 
random variate denoting the ability of a signal to be de- 
tected. The Beta distribution was selected due to its ease 
and simplicity of generation and its desirable behavior as 
alpha is allowed to vary. All outcomes on V are on the 
range (0,1) and can be envisioned, under certain conditions, 
to be the "probability" that a random signal v is "detect- 
able". Furthermore, it is possible to imagine a case where 
V is degenerate at 1 denoting that signal v is certainly 
detectable. Clearly, when <x = 1 , v becomes a uniform(0,1) 
outcome. This implies that the "ability" of signal j to 
be detected is random with an equal likelihood of being 
undetectable as detectable. Thus, by varying the <* param- 
eter of a Beta(<x,1) random variable, it is possible to 
specify to what degree each signal is expected to be "de- 
tectable" . 

For integer o< ^ 1 and 0=1, the Beta distribution has 
the following cdf: 

F (v| ex , 1 ) = v* , 0«iv<1 . 

Since all values of v** lie on the interval (0,1), it is a 
simple matter to generate random Beta (<*,1) variates using 

e< 

the probability integral transform of V ~ U. Let U be a 
uniform(0,1) random variable and V an outcome on U. 
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Then , 



V* = u 



and 



V = U 1 ^ 



,i A 



Because the lim u ' -»1 , for a sufficiently large , the 



Beta (<x, 1) distribution can, in general, be used to repre- 
sent the case where *r|\ = 1 ^. An o< value of 100 was 
selected to simulate a signal which is virtually certain 
to be detectable. An intermediate case of «* = 10 is also 
tested. 

Each signal v^ is therefore defined to be an outcome on 
Vj . In the physical sense, « = 1 represents a system where 
all receivers, in some way, act alike or show dependency. 
For example, if an outcome on V^U(0,1) is a low value, 
nearly all the receivers in the system, regardless of their 
ability to detect the signal, will be restricted from 
doing so simply because the signal is not readily detect- 
able. Any outcome on V has this affect on the entire sys- 
tem, thus causing the receivers to show interdependence. 

On the other hand, if V is degenerate at 1 (simulated by a 
large alpha value) , the detection of the signal is based 
solely on the characteristics of the receiver. In this 
manner, the receivers tend to act independently of one 
another. Hence, changes in alpha, in a restricted sense, 
give some indication of correlation through receivers. The 
case where o< = 1 0 demonstrates an intermediate degree of 
dependence between receivers. 
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In this model, each signal v is scanned by each receiver. 
As previously mentioned, a function of the model is to 
statistically relate each receiver to each signal to deter- 
mine actual detections. T^(v) is computed for each receiver 
using (6) and represents the probability that receiver i 
detects signal j. To determine if the detection occurred, 

(v) is compared against a uniform(0,1) random number, 
where if 

U(0,1) T. :£ detection occurs 
1 

U(0,1) ^ no detection occurs. 

Recall that Z is a k-component vector of zeros and ones 
denoting which receivers did or did not detect a given 
signal. Hence, Z = z is an outcome on the k comparisons 
above, and becomes the element in the sample space S which 
specifies which combination of receivers detected the 
signal . 

C. COUNTING: "SUBROUTINE COUNT" 

The estimators developed in section III rely on certain 
"counts" of events related in various fashions to the re- 
ceiver system. Subroutine COUNT takes the data created by 
the signal generator and performs the necessary accounting. 
Subroutine GNRATE passes the vector N to subroutine COUNT. 

(N is the 2 -dimensional vector containing elements n , n 

2 2 

being the number of times, out of s trials, that z, zeg, 
occurs . ) 
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Let B denote an index of the elements in the vector N. 
Suppose B = 4 represents both receivers 1 and 2 detecting 
a common signal, and over many signals this combination 
occurs twelve times. This event is then annotated, as 
N(4) = 12. Note that N(1) is the zero vector and cannot 
be observed. A convenient method of arranging B is to 
consider the binary number system. Figure 1 demonstrates 
how the binary numbers can be used to order B for a 
4-receiver system. For example, if receivers 1, 2 , and 3 
all detect a common signal, this is associated with the 
binary number 0111 and the related value of B is the 
base ten equivalent, 7. B relates directly to the random 
vector Z. By computing a value for B, Z can be obtained 
simply by computing the binary equivalent of B. One 
convenient algorithm for computing an outcome on Z is as 
follows : 



1 . 


Let B = 1 




2. 


Draw a U ( 0 , 1 ) random 


number 


3. 


If U(0, 1 ) <T i7 let B 


= B + 


4. 


If i^k, go to 2 and 


repeat 


5. 


Let z = base 2 B. 





Using Figure 1 as a reference, it can easily be shown 

how the necessary counting is performed. Notice that the 

array of binary numbers is actually a reflection of the way 

each receiver is listed by the index. By considering the 

binary array to be a (2 X k) matrix, various row and column 

sums can be used as multipliers in the counting procedure. 
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Figure 1 • Binary Counter for a 4-Receiver System 
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The total number of signals detected, t, is the sum 
over elements n^,...,n r in the vector N. The number of 

v 

signals detected by receiver i, nr , can be computed by 
looking in the appropriate column in the binary matrix. 
Receiver 1 is represented in the array by the far right 
column. The value for m^ is computed by summing those 
elements in the vector N for which a 1 appears in the far 
right column. This procedure is repeated over all k 
columns. 

The value of m*, m* = (the number of signals de- 

tected by receivers i and j simultaneously) , is obtained 
by summing those elements in N which contain two or more 
ones in the associated binary number. Remember in com- 
puting m* , that if, for example, three receivers detect a 
common signal, then that element of N will be counted three 
times. Likewise, in a four receiver detect, that element 
of N will be counted six times. Hence, depending on the 
number of ones in the associated binary number, there is 
an appropriate multiplier assigned to each element of N. 

The value for JL . . (rn.m.) is the sum over the totals 

i<3 i 3 

obtained in each column, done for all i< j. 

D. COMPUTING ESTIMATES: "SUBROUTINE SOLVE" 

Subroutine COUNT passes all the necessary accounting 
information to subroutine SOLVE which performs the opera- 
tions and optimizations required to produce estimates of 



27 



rr^ and s as discussed in section III. Using the input 
parameter METHOD in the main routine, it is possible to 

v 

specify which one or more methods to be used. 

1 . Method 1 ; Maximum Likelihood 

Maximum likelihood estimators will be found using 
numerical methods because as k increases, Lagrangian and 
other techniques quickly become too burdensome. In this 
simulation, the non-linear maximization approach used is 
the Generalized Reduced Gradient Technique (see Lasdon, 

[Ref. 4]). This computer method is available in most 
computer libraries and is easy to use. 

Library routines DATAIN, GRG, and OUTRES are called in 
sequence. Routine DATAIN reads all necessary data while 
routine GRG performs the optimization. It is necessary for 
the user to supply a subroutine GCOMP which evaluates con- 
straint and objective function values (see Appendix A) . 
Routine OUTRES provides the user information on each iter- 
ation of the maximization. The quantity of output can be 
varied by a user inputted flag in DATAIN. In this simula- 
tion, the iterative data is totally suppressed. 

2 . Method 2: Method of Moments 

This method is perhaps the only one of the three 
discussed which can be computed by hand. Estimates for 
th and s are simple functions of the data provided by 
subroutine COUNT and are computed as discussed in section 
III. 
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3 . Method 3: Least Squares 



Again, numerical techniques are necessary in 

solving least squares estimators. An initial value of 

P (A) = .1 begins the least squares minimization. The 

value .1 is chosen because of the potential presence of 

trivial solutions when the system intercept probability 

falls within the interval [0,.1) (see Knorr, 1979). P (A) 

is incremented in steps of .01 on the interval (.1,1) . 

For each value of P (A) , ^ (j) is computed using (4) and 

z 

• 

*P (j) is numerically evaluated using the algorithm on 
z . 

page 19. The value of P(A) which minimizes the least 
squares expression (5) becomes the system intercept prob- 
ability and is used to compute tT and "s. 

E. OUTPUT: "SUBROUTINE OUTPUT" 

Two forms of subroutine OUTPUT are used depending on 
which part of the simulation is being performed. Recall 
that- in the first part of the simulation, 72 environments 
were examined one time each to obtain a feel for the be- 
havior of the estimators. A sample listing of the results 
is shown at Figure 2. 

The second part of the simulation focuses on analyzing 
the mean absolute error (MAE) , bias and variance of the 
estimators for tt\ and s. Twelve of the environments were 
selected for analysis and replicated 100 times each. For 
each replication, the MAE of the element in the vector Tf 
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was computed by comparing the estimated values to the 
expected values of rf. The expected value of Tt\ is easily 
computed given 1^, the specified ability of receiver i to 
detect a signal of strength V, and the distribution of V. 
Given that the form of the function for = T^(V) = 

1^ • V, E ( TfJ = E(l^ • V) = 1^ • E (V) . The expected 
value of a Beta(<*,l) random variable can be shown to be 
<*/(!+<*). Hence, E( TTJ = l i • «*/ ( l+«) . The MAE of the 
receiver intercept probability becomes ABS ( rf^ - E ( T"T ) ) . 
The MAE's are summed across the entire probability vector 
to produce an MAE estimate for the system. The 100 system 
MAE estimates are then sectioned into ten blocks of ten 
replications each, making use of the computer library 
routine SECTN. In this manner, estimated sample parameters 
on the system MAE (i.e. mean, variance, etc.) are computed 
along with estimated parameters of the sample parameters. 
Figure 3 shows a typical output listing for subroutine 
SECTN. (Remember that these sample parameters are on the 
estimate of the MAE for tt, not on the estimate of n di- 
rectly. ) 

Following the sample parameters is a listing of the 
initial input to the signal generator. Next, the method of 
analysis used is shown, followed by direct estimates of the 
mean and variance for each element in it. 

The identical procedure is followed for analyzing the 
estimator §. A typical output listing for the analysis on 
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's is shown at Figure 4. The above procedure is duplicated 
for each of the three methods discussed in section III. 
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INPUT PARAMETERS TC SIGNAL GENERATOR 

NUMBER OF SIGNALS GENERATED: IOOO 

NUMBER CF RECEIVERS: 3 

ALFA PARAMETER: 100.0 

RECEIVER PROBABILITY VECTOR: 0.20 0.50 0.80 



CELL COUNTS 



Nl< 


I ) = 


22 


N ( 


2) = 


83 


N ( 


3) « 


14 


N( 


4) = 


312 


h< 


5) * 


75 


N ( 


S) = 


324 


N( 


7) a 


86 


QPTIMIZATICN CCEFFICIENTS 



OBSERVED NUMBER OF DETECTIONS BY REC I EVER I: 

197.0 507.0 797.0 

OBSERVED NUMBER OF NO-DETECTS BY REC I EVER I: 

719.0 909. 0 119.0 

OBSERVED NUMBER OF TIMES J REC I EVERS DETECTED A COMMON SIGNAL: 

917.0 913.0 86.0 

NUMBER OF SIGNALS INTERCEPTED: 916.0 



OPTIMIZATION METHOD: MAXIMUM LIKELIHOOD/CONDITIONAL MAXIMUM LIKELIHOOD 

ESTIMATES OF INTERCEPT PROBABILITIES: 

0.20 0.51 0.80 

ESTIMATE OF THE TOTAL NUMBER OF TRANSMISSIONS: 992.79 



OPTIMIZATION METHCO : METHOD OF MOMENTS 

ESTIMATES OF INTERCEPT PROBABILITIES: 

0.20 0.51 0.81 

ESTIMATE OF THE TOTAL NUMBER OF TRANSMISSIONS: 985.05 

OPTIMIZATION METHOD: LEAST SQUARES 

SYSTEM INTERCEPT PROBABILITY : 0.92 

ESTIMATES CF INTERCEPT PROBABILITIES: 

C.20 0.51 0.80 

ESTIMATE GF THE TOTAL NUMBER OF TRANSMISSIONS: 995.65 



Figure 2 . Sample Output - Form 1 
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ESTIMATED SAMPLE PARAMETERS 
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V. ANALYSIS OF RESULTS 



The purpose of this section is to demonstrate the 
results of the simulation described in section IV and to 
discuss, in general terms, trends and observations about 
the behavior of the different methods of analysis as they 
apply to the model. The first part of the simulation used 
each of the three methods in 72 different environments to 
obtain estimates of the total signal population size. In 
the second part of the simulation, twelve environments were 
replicated 100 times each and mean absolute errors (MAE) 
of the estimates for radio intercept probabilities, fT^ , 
and total signal population size, s, were obtained. The 
mean and variance of the MAE estimates were computed over 
all replications. Additionally, the mean and variance of 
the estimators themselves were computed. 

The data shown in Table 1 and Table 2 summarize the 
results obtained in the first part of the simulation. In 
Table 1 are the estimates of signals generated for a 3- 
receiver system using each of the three methods of analysis. 
The input values for the radio intercept capabilities and 
the alpha parameter are listed in the first column. The 
actual numbers of signals generated are listed in the second 
column comprising an environment. The 6-receiver intercept 
systems are shown in Table 2. In the 6-receiver environments. 
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two receivers share a common value for 1^, thus, a vector 

of .6/. 7/. 8 implies that two receivers were specified to 

have 1. values of .6, two of .7, and two of .8 . 
i 

This part of the simulation was designed to give a 
feel for how the estimators would behave over a wide 
range of conditions and to help select an interesting set 
of environments from which to analyze in more detail. Re- 
source limitations precluded a complete analysis of all 
environments. Those situations indicated with an (*) are 
the ones selected for replication. 

Though no formal claims can be made about the estimators 
in the first stage of the simulation, a review of the data 
in Tables 1 and 2 seems to indicate that all the methods 
perform better as alpha increases (as the receivers become 
less dependent) and as the receiver intercept probabilities 
are increased. This result is intuitively appealing 
because changes in the parameters which increase the ability 
of a signal to be detected or a receiver to detect a signal 
will result in an increase in signals detected. As a 
higher portion of the total signals are detected, more data 
are available for estimating the total number of signals 
present. 

The results of the second part of the simulation are 
shown in Tables 3-8. Tables 3-5 show mean and variance 
estimates for the receiver intercept probabilities for 
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alpha equal to 1, 10, and 100 respectively. Tables 6-8 
show mean and variance estimates for the total signal popu- 
lation sizes. Notice that all mean estimates of receiver 
intercept probabilities tend to be positively biased. The 
bias is more significant for alpha equal to 1 and improves 
greatly for alpha equal to 10, and tends to become nega- 
tively biased for alpha equal to 100. Thus, it appears 
that a high degree of dependence between receivers will 
have a significant impact on the bias of the estimators. 
Similar trends are not as readily apparent on mean esti- 
mates of population size. Though maximum likelihood and 
method of moment estimators seem to be negatively biased, 
the least squares estimator shows several instances of 
strong positive bias, particularly for small sample size. 
One possible explanation for this may be found in the large 
variance estimates for the least squares estimators. This 
may be an indication that the model is not adequately dis- 
tinguishing between the trivial and non-trivial solutions 
for ^(A). There appears to be consistently much better 
estimates for signal population size as alpha increases. 

With the wide variety of changing parameters and rela- 
tively few replicated trials, it is not possible to make 
comparative claims between the estimators under changing 
conditions, but only to look at the estimators under the 
conditions tested. However, because there were four 
environments tested for each value of alpha, there are some 
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suggestions about the quality of each estimator which can 
be made. For each value of alpha, the sum of the means 
and variances of the MAE estimates was computed over all 
environments tested for each estimator. These sums repre- 
sent a score for each estimator over various conditions but 
with constant alpha. These mean absolute error scores for 
estimates of radio intercept probabilities and total signal 
population size are shown in Table 9. Notice that the 
method of moments estimator appears to perform the best for 
estimates of rr^ when alpha equals 10 and 100. The variances 
of the estimates are, however, too large to claim it is the 
best estimator. This table does show that there is a sig- 
nificant reduction in error as receiver dependence decreases. 
No one estimator appears to be better for signal population 
size over all tested values of alpha, but again, the esti- 
mators do tend to improve as alpha increases. It is inter- 
esting to note that maximum likelihood estimates tend to 
have the smallest variability while the least squares esti- 
mates have the largest. 

Ideally, all 72 environments should be replicated and 
estimates compared over all conditions to obtain performance 
criteria on each estimator. A data analysis of this mag- 
nitude would provide valuable insight into the problem but 
is beyond the scope of this thesis. 
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Input 
Values ' 

< ' 1 i 


Signals 

Generated 


Signals 

Detected 


Maximum 

Likelihood 

Estimates 


Method of 
Moments 
Estimates 


Least 

Squares 

Estimates 


oC = 1 




25 


13 


14.45 


13.46 


15.29 


.6/. 7/. 8 


100 


70 


82.78 


79.26 


85.37 




1000* 


650 


769.90 


734.99 


802.47 




10000 


6537 


7804.23 


7596.42 


7971 .95 




25 


7 


9.55 


10.67 


9.09 


.2/. 3/. 4 


100* 


40 


68.78 


64.36 


72.73 




1000 


378 


785.35 


771.09 


804.26 




10000 


3651 


7490.23 


7330.80 


7606.25 




25 


14 


17.56 


19.20 


16.67 


.2/. 5/. 8 


100 


54 


66.48 


64.57 


68.35 




1000 


547 


750.55 


759.06 


749.31 




10000 


5465 


7590.86 


7459.31 


7697.18 


oc = 10 




25 


24 


26.58 


29 . 29 


26.67 


.6/. 7/. 8 


100 


98 


101.42 


100.26 


101.03 




1000 


955 


999.50 


997.43 


994.79 




10000* 


9522 


9951 .69 


9942.84 


9918.75 




25 


21 


27.76 


27.90 


27.63 


.2/. 3/. 4 


1 00 


62 


84.35 


81 .73 


86.11 




1000 


601 


982.82 


1007.44 


969.35 




10000 


6262 


10184.48 


10208.45 


10100.00 




25* 


19 


24.94 


23.63 


26.03 


.2/. 5/. 8 


100 


86 


99.18 


98.59 


100.00 




1000 


864 


990.72 


974 . 08 


1004.65 




10000 


8809 


10020.67 


10043.02 


10010.23 


oc = 100 




25 


24 


24.79 


24.32 


24.74 


.6/. 7/. 8 


1 00 


98 


100.96 


100.97 


101.03 




1000 


980 


1004.61 


1009.47 


1010.31 




10000 


9720 


9988.40 


9973.44 


10020.62 




25* 


20 


42.46 


36.00 


51 . 28 


.2/. 3/. 4 


100 


61 


85.26 


90.56 


82.43 




1000 


651 


948.93 


950.72 


943.48 




10000 


6539 


9887.67 


9830.35 


9907.57 




25 


25 


27.40 


28 .21 


26.88 


.2/. 5/. 8 


100 


93 


100.46 


99.64 


101.09 




1000* 


906 


995.26 


984.95 


1006.67 




10000 


9125 


9972.98 


9965.46 


10027.47 



• Estimates of Signals Generated/3-Receiver System 
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Table 1 



Input Signals 

Values Generated 
* ,l i 


Signals 

Detecte 




* 




oC = 1 




25* 


19 


.6/. 7/. 8 


100 


72 




1000 


773 




10000 


7965 




25 


14 


.2/. 3/. 4 


100 


49 




1000 


566 




10000 


5614 




25 


17 


.2/. 5/. 8 


100 


70 




1000 


719 




10000* 


7344 


oc = 10 




25 


25 


.6/. 7/. 8 


100 


100 




1000 


996 




10000 


9969 




25 


24 


.2/. 3/. 4 


100* 


91 




1000 


844 




10000 


8568 




25 


24 


.2/. 5/. 8 


100 


97 




1000* 


990 




10000 


9811 


oc = 100 




25 


25 


.6/. 7/. 8 


100* 


99 




1000 


998 




10000 


9994 




25 


22 


.2/. 3/. 4 


100 


79 




1000 


876 




10000* 


8777 




25 


24 


.2/. 5/. 8 


100 


99 




1000 


999 




10000 


9926 



Maximum Method of Least 
Likelihood Moments Squares 
Estimates Estimates Estimates 



19.40 


18.74 


19.59 


73.95 


69.83 


76.60 


803.01 


716.65 


831.18 


8248.49 


7510.09 


8384.21 


14.98 


14.62 


15.56 


61.17 


58.70 


62.03 


747.70 


698.84 


754.67 


7886.43 


7512.48 


7907.04 


20.02 


21.25 


19.54 


75.01 


74.83 


76.92 


796.05 


751.39 


798 . 89 


8104.96 


7606.72 


8251 . 68 



25.04 


24.87 


25.00 


100.23 


99.54 


100.00 


997.79 


993.13 


996.00 


9989.28 


9955.48 


9969.00 


27.90 


27.83 


28.57 


104.85 


105.35 


105.81 


977.51 


978.60 


981 .40 


9958.32 


9866 . 30 


9962.79 


24.33 


24.44 


27.27 


98.40 


99.23 


98.98 


1006.67 


995.82 


1010.20 


9956.08 


9924.80 


9910.10 



25.01 


24.85 


26.04 


99.07 


97.91 


99.00 


998.94 


997.17 


998.00 


10000.83 


9992.41 


9994.00 


25.42 


23.06 


26.51 


86.98 


94.81 


86.81 


985.43 


978.01 


995.45 


9807.58 


9893.83 


9973.86 


24.12 


24.93 


24 . 00 


99.79 


100.70 


101.02 


1006.50 


1007.47 


999.00 


10002.23 


9976.55 


9926.00 



• Estimates of Signals Generated/6-Receiver System 
(Two receivers share a common intercept probability) 
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Table 2 
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TABLE 3. MEAN AND VARIANCE ON ESTIMATES OF RECEIVER INTERCEPT PROBABILITIES 
(MEAN ABSOLUTE ERROR ESTIMATES ARE COMPUTED OVER THE ENTIRE 
PROBABILITY VECTOR. > 
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TABLE 4. MEAN ANO VARIANCE ON ESTIMATES OF RECEIVER INTERCEPT PROBABILITIES 
(MEAN ABSOLUTE ERROR ESTIMATES ARE COMPUTEO OVER THE ENTIRE 
PROBABILITY VECTOR.) 
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TABLE 5. MEAN AND VARIANCE ON ESTIMATES OF RECEIVER INTERCEPT PROBABILITIES 
(MEAN ABSOLUTE ERROR ESTIMATES ARE COMPUTED OVER THE ENTIRE 
PROBABILITY VECTOR.) 
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NJMBER SIGNALS GENERATED MAXIMUM METHOD OF LEAST 
NUMBER RECEIVERS LIKELIHOOD MOMENTS SQUARE 
RECEIVER PROB VECTOR ESTIMATES ESTIMATES ESTIMAT 
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TABLE 8. MEAN AND VARIANCE ON ESTIMATES OF TOTAL SIGNAL POPULATION SIZE 
(MEAN ABSOLUTE ERROR ESTIMATES ARE COMPUTED BY COMPARING THE 
ESTIMATED SIGNAL POPULATION TO THE NUMBER OF SIGNALS GENERATED 



MEAN ABSOLUTE ERROR SCORES 
ON ESTIMATES OF RADIO INTERCEPT PROBABILITIES 







Maximum 

Likelihood 

Estimates 


Method of 
Moments 
Estimates 


Least 

Squares 

Estimates 


Alpha = 1 


Z E (MAE) 
ZVar (MAE) 


1.5272 
.061 1 


1.8873 

.0993 


1.7616 

.3255 


Alpha = 10 


ZE (MAE) 
ZVar (MAE) 


.5904 

.0229 


.5684 

.0237 


. 6677 
. 0996 


Alpha = 100 


ZE (MAE) 
ZVar (MAE) 


.6046 

.0261 


.5822 

.0295 


.5905 

.0449 



MEAN ABSOLUTE ERROR SCORES 
ON ESTIMATES OF TOTAL SIGNAL POPULATION SIZE 







Maximum 

Likelihood 

Estimates 


Method of 
Moments 
Estimates 


Least 

Squares 

Estimates 


Alpha = 1 


ZE (MAE) 
ZVar (MAE) 


2241 . 54 
4591 . 70 


2787.95 

4465.26 


2115.60 

14003.57 


Alpha =10 


ZE (MAE) 
ZVar (MAE) 


66.34 

598.71 


102.47 

1217.23 


121.84 

4107.67 


Alpha = 100 


ZE (MAE) 
ZVar (MAE) 


117.85 

2461.50 


68.81 

1437.97 


94.11 

2915.05 



Table 9 • Mean Absolute Error Scores 
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VI. SUMMARY AND RECOMMENDATIONS 



This thesis has presented a development of various 
estimators which can be used to estimate the total number 
of signals passing through an acquisition system given 
only a portion were detected. Likewise, estimators were 
found for estimating the intercept probabilities for each 
receiver in the system. These estimators were used in the 
context of a model developed to represent the signal de- 
tection process. The model suggested is the foundation 
for a simulation conducted over a variety of conditions 
including receiver and signal characteristics as well as 
transmitter activity. The simulation results provided some 
general insight into the quality of the estimators devel- 
oped and their behavior over varying conditions. The 
question of dependence between receivers was briefly ad- 
dressed and it was shown that as dependency increased, the 
quality of the estimates decreased. 

The work presented here is not viewed as a final solution 
to the problem. The model used was designed for flexibility 
and it would be a simple matter to refine and expand the 
detection process used within this report. The simulation 
conducted was sufficient for validating the model and ob- 
taining some initial insight into the quality of the esti- 
mators but was not adequate for making conclusive claims 
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about them. It is hoped that this thesis may stimulate 
others into continuing work on this subject. In particu- 

v 

lar, it is suggested that a complete experiment be designed 
and a formal data analysis of the simulation results be 
conducted to determine which method of estimation is opti- 
mal. It would equally be interesting if someone with an 
electronics background could incorporate into the model 
additional parameters or functional relationships bringing 
in some hardware considerations or radiowave characteristics. 
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APPENDIX A 



SIMULATION PACKAGE CHARACTERISTICS AND REQUIREMENTS 

The simulation discussed in section IV is designed to 
minimize user interaction. The user must decide what is 
desired to be accomplished by the simulation and modify 
the main routine and output routine accordingly. The 
material discussed in this appendix suggests simple in- 
structions on how to use the FORTRAN simulation package 
provided with this study. A complete source listing of 
the FORTRAN code is located at the end of this appendix. 

A. CHARACTERISTICS 

As currently designed, the simulation is dimensioned 
to handle an acquisition system of up to ten receivers. 

The total number of signals which can be generated in any 
one replication is 99,999 , limited only by the input for- 
mat statement allowing five digits. Similarly, the random 
number generator seed is formatted for up to five digits. 
To modify the simulation to handle a larger acquisition 
system or increase the number of signals desired to be 
generated is a simple matter of increasing the dimension- 
ality of the arrays and enlarging input formats. 
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B. METHOD SELECTION 



The'user must determine which one or more methods of 
estimation to be performed. Should only one method of 
estimation be desired, that method is requested through a 
coded input parameter in the data base as follows: 

Maximum Likelihood. . . .METHOD = 1 

Method of Moments METHOD = 2 

Least Squares METHOD = 3. 

If more than one method is desired, the user should provide 
the lowest coded input parameter in the data base and 
establish the appropriate looping in the main routine. The 
loop established in the source listing at the end of this 
appendix provides for all three methods to be applied to a 
common signal data set created by subroutine GNRATE . 

C. REQUIREMENTS WITH THE USE OF GRG 

If the user specifies the maximum likelihood method of 
estimation to be used, the user supplied subroutine GCOMP 
must be included in the source listing. This subroutine 
contains the objective function to which the generalized 
reduced gradient (GRG) routine attempts to maximize. (In 
actuality, the GRG routine minimizes an objective function, 
thus, to maximize the log-likelihood function it is neces- 
sary to minimize the negative of the objective function.) 
Subroutine GCOMP contained in the source listing provided 
is general in nature and accurately represents the log- 
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likelihood function discussed in section III for any 
k-receiver system. No user modifications to this routine 
are necessary for systems of ten receivers or less. 

Each time the maximum likelihood method is used during 
the course of a simulation, the GRG routine is called. 

With each call to subroutine GRG, it is necessary to pro- 
vide a special input data base to support the optimization. 
This data base is read by library routine DATAIN, and is 
supplementary to the initial data base established for the 
simulation. 

D . DATA INPUT 

Six data cards initialize the simulation. An addition- 
al set of data cards are necessary for each call to sub- 
routine GRG. The size of the data set required for GRG 
is related to the number of receivers. Shown at Figure 5 
is a sample data set for a three receiver system. The 
data is preceeded by a data section number and followed by 
the input format. Below, is a description of each data 
entry by data section number. 

Data Sctn Number Data Elements and Description 



1 



Random number generator seed (read once) . 



2 



Number of signals to be generated. 



3 



Number of receivers in the system. 

Input receiver intercept probability 
vector . 



4 



52 



5 

6 

7 

8 

9 

10 

1 1 

12 

13 

14 

15 

16 

17 



Value of alpha used in generating B ( oc , 1 ) 
variates. 

Method of analysis to be used. 

Problem name. Any combination of 80 
alphanumeric characters . 

Number of receivers (values of TT. to 
be estimated) followed by a ' 1 ' and 
'O', the number of equality and in- 
equality constraints in the maximiza- 
tion. 

Number of variables with finite lower 
bounds (equal to the number of receivers). 

There should be k cards each containing 
a pair of numbers. The first number is 
the index of the variable in 9 above 
followed by its lower bound. In this 
simulation the lower bound is set at 
.0005 . 

Number of variables with finite upper 
bounds (again, equal to the number of 
receivers) . 

There should be k cards each containing 
a pair of numbers. The first number is 
the index of the variable in 1 1 above 
followed by its upper bound. In this 
simulation the upper bound is set at 
.9999. 

Number of inequality constraints having 
finite upper bounds. Enter 0. 

Initial values for TT. . Enter .50 for 
each. 

Tolerance value when certain iterative 
processes should stop. Default value 
is zero. 

Limits on the upper bound of allowed 
iterations. Default value is zero. 

Specification on the desired amount of 
output. Zero is the default value and 
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a value of one allows the user to in- 
crease or decrease output. A value of 
one is used to suppress output in this 
simulation. 

18 A pair of zero values effects the sup- 
pression of output. 

19 Anything but 'QUAD' will assure the use 
of tangent vector extrapolation for est- 
imating initial values of basic variables. 

20 If the user does not wish to partially 
or completely specify an initial basis, 
enter a zero on this card. 

For a more detailed discussion on GRG refer to a GRG user's 
guide (i.e. see Lasdon, 1975). 

E. OUTPUT SELECTION 

Two forms of subroutine OUTPUT are provided with the 
source listing. The first form is used when one or more 
environments are specified and replicated once each. This 
form would typically be used with actual field data. The 
second form of subroutine OUTPUT is used when it is desired 
to replicate one environment a number of times to allow 
for a statistical analysis of the estimators fit and "s. 

The user need only to decide which form of the output is 
applicable to the simulation being conducted and insert 
the appropriate listing. 
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Data 

Section 

Number 



Format 



Sample Data 
Card Column 



12345678911 1111111 122222222223333333333 
012345678901234567890123456789 



1 


21215 






15 


2 


10000 






15 


3 


3 






15 


4 


.60 . 


70 . 


80 


1 0F5. 2 


5 


100. 






F5 . 1 


6 


1 






15 


7 


Problem 


name . 


Any 80 Alphanumerics . 


20A4 


8 


3 


1 


0 


315 


9 


3 






15 


10 


1 




.0005 


I5,5X,E10.4 




2 




.0005 






3 




. 0005 




1 1 


3 






15 


12 


1 




.9999 


I5,5X,E10.4 




2 




.9999 






3 




.9999 




13 


0 






15 


14 


• 


50 


.50 .50 


8E1 0.4 


15 


0 






15 


16 


0 






15 


17 


1 






15 


18 


0 


0 




215 


19 


0 






A4 


20 


0 






15 



Figure 5 • Sample Data Set for a 3-Receiver System 
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APPENDIX B 



LIST OF SYMBOLS 
(alphabetically) 



A: the event (Z^O) 

B: an index of the elements in the vector N 

1^: number of data vectors z for which z. = j 

K = t ! / (n 1 . n , ) 

' 2-1 



k: number of receivers 

L(s,p): likelihood of N at n 

1^: proportion of signals of strength V that receiver i 

would detect 

M^: number of signals detected by receiver i (outcome is 



m 



. . .(number of signals detected simultaneously by 
^ receivers i and j) 



N: random vector with outcome n; NwM , (s,p) 

2-1 



n = (n , n 1 , . . . , n , ): vector of n 's in some specific 

° 1 2-1 order 2 

n : number of times z S occurs 

z 

P = Pi / • • • » p v. ): vector of p 's in same order as 

° 1 2-1 for n 2 

p (j): mass function of z 

2 * 

# 

q i = Pi /(1 - P 0 > 



S: sample space of Z 
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s: number of signals 

"s,"?^: .» estimates of s and rr, respectively 

T.(v.) = Tt. . = 1 . • v . 

13 ID 1 D 

t: number of signals detected 

U: uniform( 0 , 1 ) random number 

Vj : strength of signal j (outcome is v ^ ) 

Z = ( Z .j , . . . , Z^) : vector of Bernoulli detection or non- 

detection indicators, for a given signal, 
for all receivers 

1 2.: number of receivers which detect a given 

i=1 1 . , 3 

signal 

*tt\ ^ : probability receiver i detects signal j 

rr i = E(T i (v) ) = l i • E(v) 



« : parameter of where ^ B (<*, 1 ) 
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